Analog to Digital Conversion in Physical Measurements 
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There exist measuring devices where an analog input is converted into a digital output. Such 
converters can have a nonlinear internal dynamics. We show how measurements with such convert- 
ing devices can be understood using concepts from symbolic dynamics. Our approach is based on a 
nonlinear one-to-one mapping between the analog input and the digital output of the device. We 
analyze the Bernoulli shift and the tent map which are realized in specific analog/digital converters. 
Furthermore, we discuss the sources of errors that are inevitable in physical realizations of such 
systems and suggest methods for error reduction. 

PACS no. : 05.45. + b. 



Progress in physics is based on the intimate relationship between experiment and theory. Exper- 
iments involve measurements in which the precision of the measured quantities depends essentially 
on the particular characteristics of the measuring devices. Often this process of measurement in- 
volves a conversion of the analog measured quantity into a digital number by means of a converter. 
For such analog/digital converters, there exists an internal relationship between the quantity to be 
measured (analog input), and the result of the measurement process (digital output). We assume 
that the conversion of the analog signal into a digital number is the sole process in such converters 
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and we neglect errors associated with the input analog signal itself. Thus, the dynamics of the 
input-output relationship determines the whole conversion process and it is responsible for the pre- 
cision of the conversion itself. This problem is especially relevant for converters based on nonlinear 
processes, for which it is known that the errors grow exponentially fast. In this paper, we analyze 
the properties of a such relationship in order to identify and understand the sources of possible 
errors involved in the conversion process. 

As a paradigm of a device having a nonlinear internal dynamics, we consider the algorithmic 
analog/digital (A/D) converters p]. The internal dynamics of such converters is described by 
well-known one-dimensional chaotic maps Q, the Bernoulli shift 

x n +i = Gi(x n ) = 2x n | mod 1 (1) 

and the tent map 

x n+1 = G 2 {x n ) = 1 - 2\x n - -|. (2) 

Both maps are characterized by a positive Lyapunov exponent A = In 2 and they often serve as 
model examples in mathematical work devoted to the theory of dynamical systems (see e.g. ||). 

The Bernoulli shift is realized by the circuit shown in Fig. 1(a) 0. This circuit represents a 
X-bit algorithmic analog/digital (A/D) converter, which is a recycling multistage converter with 
one bit stage. The converter achieves A-bit resolution by converting the input once and then 
circulating the residue function G\{.) through the stage (K — 1) times. The tent map is realized 
as a Grey-code algorithmic A/D converter ||| with a folding circuit having a transfer characteristic 
given by Eq. (g) as shown in Fig. 1(b). 

To analyze the input-output relationship of such analog/digital converters from the point of 
view of the theory of dynamical systems, we apply concepts from symbolic dynamics. In analyzing 
the conversion process, we use the sensitive dependence on the initial conditions, a fundamental 
property of Eqn.(jl]) and @, to argue that precise analog/digital conversion is possible. We identify 
the sources of errors in such converters and present a simple method of error reduction. 
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Suppose we need to measure the quantity X, and let X denote the set of all possible values 
of X. Let us consider an unknown value x\ of X, which is the analog input of the converter, as 
an initial condition that is iterated internally using the chaotic map G generating the sequence 
{xk} = x\X2 ■ ■ ■ xl with Xk = G k ^ 1 (x\) and k = 1, 2, . . . , L. To describe such an orbit in terms 
of a symbolic sequence, we need to choose a partition by coarse-graining the space X. In the case 
corresponding to the maps (|l|) and (||), we split the space X = [0, 1] into two cells whose partition is 
the critical point x c = 1/2. With any given orbit {xk} one can associate its symbol sequence {a^} 
using a two- letter alphabet defined as = for x^ < x c and a& = 1 for x^ > x c . The sequence 
{a&} is called the itinerary of x\. Let O be a set of all possible symbolic sequences. 

The process of conversion is pregnant with meaning if there exists a one-to-one mapping between 
X and O. Once the itinerary characterizing the orbit is obtained, we get a result in form of a digital 
output 

y = 7(K}), (3) 

reflecting the unknown value x\. In general, the exact form of the function 7 depends on the 
internal dynamics of the converter. For a dynamics given by the maps (|l]) and (||), it takes a simple 
form in a binary basis 

L 

7(W» = 0.c lC2 ...c L = c k?~ k , (4) 

k=l 

where 

Cfc = CJfc, 

for the Bernoulli shift and 

k 

Ck = &i I mod 2 
i=l 

for the tent map Q. The latter case is sometimes referred to as the Gray code Q. 

The precision of such an analog/digital converter depends on the length L of the itinerary. In 
principle, the digital output becomes arbitrarily precise for L large enough, adding one binary digit 
at each internal iteration of Eqs. (|l|) or (|2|), as symbolized in Eq. (Q). In practice, the precision 



of the digital output is limited by several factors. The following main sources of errors in the 
conversion process may be identified: 

(i) Inaccuracy in modeling: the internal dynamics of the converter results in a linear map with 

slope s ^ 2. 

(ii) Partition point placed at x c ^ 1/2. 

These errors have a significant influence on the precision of the digital output. Errors of the above 
types destroy the one-to-one mapping between X and O as expressed by Eqs. (|lj) and In order 
to deal with errors (i) and (ii), we address the following question: Can we still use converting 
devices with internal chaotic dynamics since errors grow exponentially fast in them? 

To visualize the effect of changes in the slope (i), we present in Fig. 2 the plots of the input- 
output relations y = f{x\) for the Bernoulli shift [Fig. 2(a)] and for the tent map [Fig. 2(b)]. 
We choose the discrepancies in the slope [e s = 2 — s) much larger than in practical applications, 
to demonstrate clearly the devil's staircase like character of this function. Let us denote by £ the 
error of a single conversion, £ = \y — x%\. The maximal error, A s = max^o.i) Ci as weu as t ne 
mean error, <^(x)dx, grow linearly with the discrepancy e s . 

For our purpose, it is more important the error associated with a non-optimal placing of the 
partition point (ii) and how it influences the precision of the output. Figure 3 presents the input- 
output relationship y(x\) for the Bernoulli map (a) and the tent map (b) with the correct slope 
(s = 2) and a misplaced partition point x c = ^ — 2~ M with M = 4. The data are obtained 
using L = 24 bits at each conversion. The comparison of these pictures clearly demonstrates the 
superiority of the tent map over the Bernoulli shift for conversion purposes. The Bernoulli shift is 
not continuous at x c = 1/2, which leads to large errors when the partition point is displaced. 

To characterize the effect of misplacing the partition point quantitatively, we set an arbitrary 
tolerance level 5 « 1 and compute the cumulative probability F(5) := f$ P(C)d^, the probability 
that the error exceeds a given tolerance level. The dependence F(5) obtained for both maps 
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is shown in Fig. 4 for a realistically possible misplacement (M = 8) of the partition point at 
x c = 1/2 — 2~ 8 ps 0.496. Filled circles correspond to the tent map, which is less vulnerable to 
imperfections than the Bernoulli shift (empty circles). 

To obtain analytical estimates of the errors, let us assume that the dependence shown in Fig. 
3 is piecewise linear. If x G D = [x c , 1/2] the error occurring for the Bernoulli shift is close to 
1/2. For any x belonging to the first preimage of this interval, the error is approximately equal 
to 1/4. Furthermore, for x in the n— th preimage of the interval D, the error reads 2~ l ~ n . The 
probability distribution of the error consists thus of the sum of singular Dirac deltas P(Q = 
2~ M [5(( - 1/2) + S(C - 1/4) + S(C - 1/8) + . . .]. Calculating the cummulative distribution of error 
F(8), we get F(2~ n ) = (n — 1)2~ M , n > 1. In the variables used in Fig. 4, this relation reads 
log 2 F(log 2 S) = —M + log 2 [- log 2 6-1}. 

A similar reasoning is applicable to the tent map. For any initial condition x in the interval of 
the displacement D = [x c , 1/2], the error equals 2(1/2 — x). In this approximation the distribution 
of error P(() consists of a rectangle -Po(C) = 1/2 for ( G [0, 2~ M+1 ]. There exists two preimages 
of -D, for which the errors belong to [0, 2~ M ]. Their contribution to the distribution of error reads 
Pi(C) = 1 for ( G [0, 2~ M ]. In an analogous way, the errors generated by the n-th preimages of D are 
described by P n (() = 2 n ~ l for ( G [0, 2~ M+1 - n ]. To obtain the cumulative error distribution F(5) 
we have to sum all terms arising from P n ((), n = 0, 1, 2, . . .. Making use of the sum of a geometric 
series we arrive at _F(2~ M+1_ri ) = [2n — 2 + 2 1 ~™]2~ M ~ 1 . Equivalently, a suitable expression for 
comparison with the numerical data reads log 2 -F(log 2 5) = — M— l+log 2 [— 2(M+log 2 J)+2 M+log2 s ]. 
Above error estimates, represented in Fig. 4 by continuous and dashed lines, respectively, describe 
the numerical data very well for both maps. 

Since the errors caused by the misplacement of the partition point are mostly relevant for x at 
any rational numbers of the type k/2 n , with n = 1, 2, . . . and k = 1, 2, ... , 2 n — 1, we propose a simple 
correction scheme based on the idea of a translation of the input value on the circle (or, equivalently, 
of the acting map). Consider a vector v = {v\,V2, ■ ■ ■ vjy}, in which v\ = and all other N — 1 
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components are relatively incommensurate numbers from (0, 1). The conversion algorithm with a 

(i) 

correction scheme consists in shifting the unknown quantity and obtaining x\ = x\ + i>i| m od l, 
converting them by the procedure described above and obtaining N different raw digital results 
j/W, and performing the reverse shift j/W = y\ l ) — Uj| mod x with i = 1, . . . ,N. Some of the results 
yW, may be correct, some can be significantly wrong. Taking the average of these numbers would 
be rather meaningless; we propose to take for N an odd number, order all the results and 
accept the middle one as a final result y. To test the practical relevance of this algorithm, we took 
v = {0, y/2/2, y/3/3, y/5/5, V7/7} and use it for both maps discussed above. As shown in Fig. 4 
N = 3 (triangles) already reduces the total error by a factor close to ten. Taking the middle value 
of N = 5 as the resulting output values significantly improves even the worse converter based on 
the Bernoulli shift (diamonds). The results for the continuous tent map with an JV = 5 correction 
are so good that the cumulative error, smaller than 2 -20 , is not marked in the picture. 

The major conclusion of this work is that analog/digital converters with chaotic internal dy- 
namics can be used for precise conversion of physical signals into digital numbers. We analyzed 
the sources of errors stemming from imperfections of the converter and propose an error correction 
algorithm capable of reducing the error of the conversion. In practice, the final precision of the 
digital output is governed by the accuracy of the auxiliary vector v but, nevertheless, an improve- 
ment gained by this procedure can be expected. Besides the errors discussed in this paper there are 
other possible errors leading to imprecisions of the digital output. Firstly, the internal dynamics of 
the device is nonlinear instead of piecewise linear. Secondly, the partition point location is fuzzy 
within a finite width e > 0. The latter problem has been recently discussed in the context of 
communication with chaos J5|. 

We summarize the process of analog/digital conversion with internal nonlinear dynamics as 
given by the following steps: 

1. Input of the analog signal x\ to be measured into a nonlinear system x n+ \ = G{x n ) as an 
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initial condition. 

2. Generation of symbolic sequence {a^} by iterating the nonlinear map G(.). 

3. Calculation of 7({afc}) according to formula (||). 

4. Obtaining the digital output value y given by Eq. (||) as the result of the measurement. 
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CAPTIONS 



Figure 1: The circuit implementation of the Bernoulli shift (a) and the tent map (b). 

Figure 2: Digital output y as a function of the measured input value x\. The conversion 
scheme is based on the dynamics of the Bernoulli shift (a) and the tent map (b) with the slopes 
s = 2.0 (ideal case, diagonal) and non ideal cases s = 1.7 and s = 1.4 (thick line). 

Figure 3: As in Fig. 2, the conversions have been performed with systems based on the 
Bernouli shift (a) and the tent map (b). Systematic errors are caused by the misplaced partition 
line localized at x c = \ — 2~ 4 . 

Figure 4: Cumulative probability F of error larger than the tolerance level 5 obtained for 
the Bernoulli shift (open symbols) and the tent map (full symbols) with the misplacement of the 
partition line characterized by M = 8. The circles represent results received by measuring L = 24 
bits. Triangles and diamonds represent data obtained with L = 24 by applying the iV = 3 and 
N = 5 error-correction scheme. 
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